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Abstract 

We studied auto-associative networks in which synapses are noisy on 
a time scale much shorter that the one for the neuron dynamics. In our 
model a presynaptic noise causes postsynaptic depression as recently ob- 



tion in which the network sensitivity to an external stimulus is enhanced. 

In particular, the fixed points are qualitatively modified, and the system 

r^ , may easily scape from the attractors. As a result, in addition to pattern 

recognition, the model is useful for class identification and categorization. 



Introduction and model 



It is likely that the reported short-time synaptic noise determines the transmis- 
sion of information in the brain jT| |2| El El ■ By means of a modified attractor 
^P , neural network, we shaU illustrate here that fast synaptic noise may result in a 

f^ ' nonequihbrium condition ^ consistent with short-time depression ^ . We then 

^O , show how this in turn induces escaping of the system from the attractor. The 

^^ ' fact that the stability of fixed points is dramatically modified, in practice allows 

Q , for complex computational tasks such as class identification and categorization, 

in close similarity to the situation reported in neurobiological systems |H1 El ■ 
A more detailed account of this work will be published elsewhere |1()| . 
^ ' Consider a set of N binary neurons with configurations S = {si = ±l;i = 

^ , 1, . . ■ , N} connected by synapses of intensity 

/\ ' Wij^WijXj \/i,j. (1) 

H ; _ 

5t 1 Here, Wij is fixed and determined in a previous learning process, and Xj is a 

stochastic variable. For fixed W ={u?y}, the network state at time t is deter- 
mined by A = (S, X = {xi}). These evolve in time according to 



dPtjA) 
dt 



^ [P*(A')c(A' ^ A) - Pt{A)c{A ^ A')] (2) 
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where c(A -^ A') = pc^{S ^ S') (5x,x' + (1 -p)c^(X ^ X') (5s.s' _11_. This 
amounts to assume that neurons (S) change stochasticahy in time competing 
with a noisy dynamics of synapses (X), the latter with an a priory relative 
weight of (1 —p)/p. 

For p = 1, the model reduces to the Hopfield case, in which synapses are 
quenched, i.e., Xi is constant and independent of i. We are interested here in the 
limit p ^ for which neurons evolve as in the presence of a steady distribution 
for the noise X. If we write P(S, X) = P(X|S) P(S), where P(X|S) stands for 
the conditional probability of X given S, one obtains from ^, after rescaling 
time tp —> t and summing over X that 

—^ = J2 {Pti^'nS' - S] - P,(S)c[S ^ S']} . (3) 

S' 

Here, c[S -^ S'] = X^x ^^'(X|S) c^[S -^ S'],and the stationary solution is 

pst.^ig. Exc^[x-^x]p-Hx-|s) 

^'^" Exc«[x-x'] • (4) 

This involves an adiabatic elimination of fast variables; see technical details in 
Ref.[B], for instance. 

Notice that c[S — > S'] is a superposition. One may interpret that different 
underlying dynamics, each associated to a different realization of the stochas- 
ticity X, compete. In the limit p — > 0, an effective rate results from combining 
c-^[S — » S'] with probability P*''(X|S) for varying X. Given that each elemen- 
tary dynamics tends to drive the system to a different equilibrium state, the 
results is, in general, a nonequilibrium steady state |Q. The question is if such a 
competition between synaptic noise and neural activity is at the origin of some 
of the computational strategies in neurobiological systems. 

For simplicity, we shall consider here spin-flip dynamics for the neurons, 
namely, stochastic local inversions Si ^ —Si as induced by a bath at temperature 
T. The elementary rate then reduces c^l^ — > S'] = \I>[u -^(8,1)], where we 
assume *(m) = exp(-u)*(-u), *(0) = 1 and *(oo) = 0. Here, u^{S,i) = 
2T~^Sihf-{S), where hf-{S) — J^j^i^ij^j^j i^ ^^e net presynaptic current or 
local field on the (postsynaptic) neuron i. 

Our interest here is in modeling noise consistent with short-term synap- 
tic depression [SJ^]. We therefore assume the noise distribution P*''(X|S) = 

n,p(x,is)with 

P{xj\S) = C (m) S{xj + $) + [1 - C (m)] 6{xj - 1). (5) 

Here, rii = rn(S) = (m^(S), . . . ,7tt,*^(S)) is the Af-dimensional overlap vector, 
and C (lii) stands for a function of m to be determined. The depression effect 
here, namely, Xj — — $, depends on the overlap vector which measures the net 
current arriving to postsynaptic neurons. Consequently, the non-local choice (0) 
introduces non-trivial correlations between synaptic noise and neural activity. 
This new case also reduces to the Hopfield model but only in the limit 
$ — > — 1 for any (^ (rii) . In general, however, the competition results in a rather 
complex nonequilibrium behavior. As far as $(w + u) = 'I'(w)^(u) and P*'' (X|S) 
factorizes as indicated, time evolution proceeds by the effective transition rate 

c[S ^ S*] = cxp {-s,hf/T) , (6) 



where 

hf^Y.<'r (7) 

Here, w1^ = {l — ^^ \C, (m) + Q (m')] } uJij, are the effective synaptic inten- 
sities as modified by the noise; m = m(S), lii' = m(S') = lii — 2si£^i/N, and 

el = i^l^f, -,^1') , r - Ur - ±l,i - 1, . . . ,iV}, stands for the binary M- 
dimensional stored pattern. 

In order to obtain the effective fields lO, we linearized the rate c[S -^ S'] 
around uJy = 0. This is a good approximation for the Hebbian prescription 
Wij = N~^ J2i, £.i^j ^^ fS'i' £^s this only stores completely uncorrelated, random 
patterns and for a sufficiently large system, e.g., in the thermodynamic limit 
A^ — > oo. To proceed further, we need to determine a convenient function C in 
(|5|l. In order to model activity-dependent mechanisms acting on the synapses, 
C should be an increasing function of the field. In fact, this simply needs to 
depend on the overlaps. Furthermore, (^ (lii) is a probability, and it needs to 
preserve the ±1 symmetry. A simple choice is 

C(m) = -^5]K(S)]^ (8) 

V 

where a = M/N. We describe next the behavior that ensues from 0-® as 
implied by the noise distribution ©. 

The effective rate © may be used in computer simulations, and it may also 
be substituted in the relevant equations. Consider, for instance, the overlaps, 
defined as the product of the current state with one of the stored patterns, 
m''{S) = jf J2i SiS,i-Aiter using standard techniques, it follows from ^ that 

dtm" = 2N-^ Y^ S,"^ sinh {hf /T) - Si cosh {hf /T) , (9) 

i 

which is to be averaged over both thermal noise and pattern realizations. 

Discussion of some main results 

We here illustrate the case of a single stored pattern, M — 1. After using 
the simplifying (mean-field) assumption (sj) « Si, one obtains from lO-@ 
the steady overlap m^^^ = m = tanh{T^^m [l — (m)^ (1 -I- $)] }. This de- 
picts a transition from a ferromagnetic-like phase, i.e., solutions to 7^ 0, to 
a paramagnetic-like phase, m = 0. The transition is continuous or second order 
only for $ > <I>c = —4/3, and it then follows a critical temperature Tc = 1 \W\ . 

It is to be remarked that a discontinuous phase transition allows for a much 
better performance of the retrieval process than a continuous one. This is be- 
cause the behavior is sharp just below the transition temperature in the former 
case. Consequently, the above indicates that our model performs better for large 
negative <&,<!>< —4/3. These results are in full agreement with Monte Carlo sim- 
ulations of neural networks with fast presynaptic noise and using asynchronous 
sequential updating. 

We also investigated the sensitivity of the system under an external stimulus. 
A high sensitivity will allow for a rapid adaptation of the response to varying 
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Figure 1: (Left) The function F{m,^,S — 0), as defined in the main text, for 
presynaptic noise with <I> = 1 (sohd line) and in absence of noise, i.e., $ = — 1 
(dashed hnc). Near the attractor (to w 1), F is positive in the absence of noise, 
which leads stability of the memory. However, the noise makes F negative, 
which induces instability of the attractor. (Right) A retrieval experiment in a 
network of A^ = 3600 neurons under external stimulation for T = 0.1, S = 0.3, 
and the same values of <& as in the left graph. 



stimuli from the environment, which is an important feature of neurobiological 
systems. A simple external input may be simulated by adding to each local 
field a driving term —S^i, Vi, with < S ^ 1 0]. A negative drive for a single 
pattern assures that the network activity may go from the attractor, i^, to its 
"antipattern" , — ^. 

It follows for M = 1 the stationary overlap m = tanh[T^^F(?7i, $, (5)] with 
F(m, $, 5) = m[l — (TO.)^(H-<i>) — 5].The left graph of figure^shows this function 
for 5 — Q and $ = 1 (fast noise) and <1> = — 1 (Hopfield case). Depending on 
the sign of F, there are two different types of behavior, namely, (local)stability 
{F > 0) and instability {F < 0) of the attractor, which corresponds to to = 1. 
That is, the noise induces intrinsic instability resulting in switching between the 
pattern and the antipattern when a small perturbation S is added. 

In general, adding the fast noise destabilizes the fixed point for the interesting 
case of small S far from criticality {T ^ Tc). This is illustrated by Monte Carlo 
simulations of a network of A^ = 3600 neurons, M = 1, 6 = 0.3 and T — 0.1, 
as shown in figurenright. Starting from an initial condition near the attractor, 
the system jumps to the antipattern when fast noise is present (solid line), and 
remains in the attractor for the Hopfield case (dashed line). 

The switching property remains as the system stores more patterns. In 
order to illustrate this, we simulated a network of A^ = 400 neurons with M — 5 
overlapping patterns such that m'''^ = 1/A^ ^ ■ ^^^^^ — 1/5 for any two of them. 
The system in this case begins with the first pattern, and then evolves under 
the effect of a repetitive small stimulus +5^°' {S = 0.3) with a randomly chosen 
from 1 to 5 every 2 x 10^ MCS for each a. As shown in figure|21 lacking the noise 
($ = —1), the system remains in the initial pattern. However, in the presence 
of some noise ($ = 0.05 in this simulation), there is continous jumping from one 
attractor to the other, every time the new attractor is presented in the stimulus. 
This property is robust with respect to the type of patterns stored jlO| . 
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Figure 2: Sensitivity of the system under repetitive external random stimulus, 
as discussed in the main text. The top graph shows the Hopfield case ($ ~ —1). 
Here, neuron activity is represented at vertical axe and simulation parameters 
are N = 400, T = 0.1 and (5 = 0.3. 



Summing up, equations ©"(01) provide a rather general framework to model 
activity-dependent processes. We here briefly reported on some consequences of 
adapting this to a specific case. In particular, we studied a case which describes 
neurobiologically-motivated fast noise, and study how this affects the synapses 
of an auto-associative neural network with a finite number of stored patterns. 
Assuming a noise distribution with a global dependence on the activity, jSJ, 
one obtains non-trivial local fields which lead the system to an intriguing 
emergent phenomenology. We studied this case both analytically and by Monte 
Carlo simulations using Glauber, spin-flip dynamics [S]. We thus show that 
a tricritical point occurs. That is, one has (in the limit a — + 0) first and 
second order phase transitions between a ferromagnetic-like, retrieval phase and 
a paramagnetic-like, non-retrieval phase. The noise also happens to induce a 
nonequilibrium condition which results in an important intensification of the 
network sensitivity to external stimulation. We explicitly show that the noise 
may turn unstable the attractor or fixed point solution of the retrieval process, 
and the system then seeks for another attractor. This behavior improves the 
network ability to detect changing stimuli from the environment. One may 
argue that the process of categorization in nature might follow a similar strategy. 
That is, different attractors may correspond to different objects, and a dynamics 
conveniently perturbed by fast noise may keep visiting the attractors belonging 
to a class which is characterized by a certain degree of correlation between its 
elements. A similar mechanism seems at the basis of early olfactory processing of 
insects J5', and instabilities of the same sort have been described in the cortical 
activity of monkeys and other cases |H] . We are presently studying further 
variations of the model above. 
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